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Abstract 



Fluctuations of the order parameters of the Gardner model for any a < a c are studied. It is 
proved that they converge in distribution to a family of jointly Gaussian random variables. 



1 Introduction and Main Results 

The Gardner model was introduced in []G|] to study the typical volume of interactions between each 
pair of N Ising spins which solve the problem of storing a given set of p random patterns {£^}jx=i- 

The components Q of the patterns are taken usually to be independent random variables with zero 
mean and variance 1. After a simple transformation this problem is reduced to the analysis of the 
asymptotic behaviour of the random variable 



@N,p(k) 



'N 



I r r djf[9(N-V 2 (^\j)-k), 
J(J,J)=N £fj 



(1.1) 



where the function 9(x), as usually, is zero in the negative semi-axis and 1 in the positive and Ojv 
is the Lebesgue measure of iV-dimensional sphere of radius A 1 / 2 . Then, the question of interest is 
the behaviour of \og@N,p(k) in the limit N,p — > oo, -fe — > a. Gardner |G|] had solved this problem 
by using the so-called replica trick, which is completely non-rigorous from the mathematical point of 



view but sometimes very useful in the physics of spin glasses (see [M-P-V] and references therein). 
She obtained that for any a < a c (k), where 



1 f°° 9 , 

a c (k) = (-±= / (u + kfe~ u l 2 du)-\ 
V2vr J-k 



(1.2) 



the following limit exists 



N,p- 



lim 

*oo,p/N- 



-E{\o g e N , p (k)} 

*a iv 



mm 

0<g<l 

1 



aE{ logH 
1 



u^fq + k 



2 1-^ + 2 l0g(1 -^. 



(1.3) 



where u is a Gaussian random variable with zero mean and variance 1, H(x) is defined as 

H(x) = -== / e - * /2 dt (1.4) 



and here and below we denote by the symbol E{...} the averaging with respect to all random pa- 
rameters of the problem and also with respect to u. And i log @N,p{k) tends to minus infinity for 
a > a c (k). 
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In the paper | S-T2f] (see also | S-T3(| ) we have studied the Gardner problem in a regular mathematical 
way and proved that for any a < a c formula ( |1.3|) is valid while for a > a c any -^E'jlog &N,p(k)} — > 

— oo, as N,p — ► oo, p/N — ► a. We studied the case = ±1, but of course the same results are valid 
for any distribution , if i£|£}^| 4 < oo. 

To obtain this results we introduced an intermediate "modified" Hamiltonian depending on the 
parameters e > 0, z > 0. 



Tt(Ji k, h, z, e) 



^logH 



'k- (£ (/x) , J)iV-i/2 



+ (h,J) + -(J,J) 



(1.5) 



where the function H(x) is defined in ( [L.4| ) and ft, = (h±, h^) is an external random field with 
independent Gaussian hi with zero mean and variance 1. 
The partition function for this Hamiltonian is 



ZN,p(k,h,z,e) = o N l J d J exp{— TC e ( J, k, h, z, e)}. 



J1.6) 



(1.7) 



We denote also by (...) the corresponding Gibbs averaging and 

fN, P (k, h, z,e) = — log Z N}P (k, h, z, e). 
In R5-T2 | we have proved the theorem: 

Theorem 1 For any a < 2, k > 0, there exists e*(a, k) such that for any e < e*(a, k) and z < e -1 / 3 
there exists 



lim E{f NtP (k,h,z,e)} 

N ,p— > oo , a jv — » a 



F(a, k, h, z, e) 



F(a, k, h, z, e), 



max mm aE < log H 

R>0 0<q<R 

2R-q 2 &V 



u^/q + k 

y/e + R-q 

z h 2 



(i. 



where u is a Gaussian random variable with zero mean and variance 1. 



Similar results for small a were obtained in p?2j| for the so-called Gardner-Derrida model. In the paper 
[ T4] the fluctuation of the order parameters for the Gardner-Derrida model were studied, but only for 
small enough a. 

An important ingredient of the analysis of the free energy of the model (1.5) in [ S-T2j| was the 
proof of the fact that the variance of its order parameters (or the overlap parameters) disappears in 
the thermodynamic limit. In the present paper we study the behaviour of fluctuations of the overlap 
parameters, defined as 



R, 



Lm 



i-(j( ( U W ), (l,m = l,...n), 



N 



where the upper indexes of the variables J mean that we consider n replicas of the Hamiltonian ( |1.5| ) 
with the same random parameters {£^}u=1j {h}> but different J^ l \ . . . , J^ n \ 
We introduce also the notations: 



q = N^{{R h2 )-q) 



1 (J (/) ,J (m) ) 



ATl/2 



' 'J {l \(J)). 



11-10) 



ATl/2 
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Here and below J = J — (J) and (q, R) is the unique solution of the system of equations: 



(R 



a T? / a 2 f VQu + k 



-E { A z y ]> + h 

R-q + e \ \^R-q + eJ J 

a (, j \ a f y/Q u + k 



{R-q + efl 2 



Q L ,2 
+ ^ + h\ 



{R-q) 2 R-q 



A(x) = -i^ l0gHW 



with 



To avoid additional technical difficulties below we assume that {£,• } are independent Gaussian ran- 
dom variables with zero mean and variance 1. 
The main result of the paper is 

Theorem 2 Consider any a < 2, k > 0, e < e*(a, k) and z < e -1 / 3 . Then for any integer n 
the families of random variables {^fN{R^ m — E(Ri rn ))}i <m <: n , converges in distribution, as N,p — > 
oo, p/N — > a, to i/ie Gaussian family of random variables {vi trn }i <m < n > with the covariance matrix: 

E{vi !m vi >m } = A , 

E{vi,mVi )m /} = B (m^m'), (1-12) 
E{vi tm vi>, m i} = C (m,m',l,l' are different). 



^ m N,p^oo,p/N^a E {(^1,2)} ~~ T r(n-1) A™ 

]im Nnp/N ^ a E{(T 2n }} = T -^B" (1-13) 



T(2n- 


-1) 


T(n- 


-1) 


T(2n- 


-1) 


T(n- 


-1) 


T(2n- 


-1) 


T(n- 


-1) 



In particular, 



^ m N,p^oo,p/N^ a E{q n } 

where the constants A$, Bq, Cq, A, B, C depend on a,k,z,e and all odd moments for these random 
variables tend to zero. 

Remark 1 In fact it follows from our proof (see proofs of Lemmas 3,4,5 in Sec. 2) that {7] ]m }; <m < n 

and {Ti}i< n in some sense do not depend on the random variables } and {hi}, i.e. if we consider 
P- some product of {T^ m }i <m < n and {Ti}i< n , then 

lim E{((P)-E(P)) 2 } = 0. (1.14) 

JV ,p— >oo ,p/N — >a 



As it was mentioned above, similar results were obtained in [T4] for the Gardner-Derrida model for 
small a and for the Sherrington-Kirkpatrick model for the high temperature. We would like to mention 
also the work [ Gu-T ] , where the fluctuations of the overlap parameters for the Sherrington-Kirkpatrick 
model in the high temperature region were studied by the method of characteristic functions. 

One of the most important feature of our Hamiltonian (|l.5| ) , which allows us to prove Theorems [l] 
and H for any a < a c (k) is that it has the form 

-W = X>(S M )-|(J,J)-(h,J), S m = ^(J,£(m)), (1.15) 

where g(x) is a concave function. It allows us to use the Brascamp-Lieb inequalities ( see [[[]]), according 
to which for any integer n and any x 6 H N 

fj,x)\ 2n \ T(2n-1) /|x| 2 \ n 

' — ~^F7Z i \ ( at ) • (1-16) 



N J I z n T(n - 1) V N 
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Besides, for any smooth function / 



((/-(/)) 2 ><^(|V/| 2 ). (1.17) 



Below we use the representation (1.15) of TL and the following properties of the functions g{x): 

g(x)<0, -C<g"<0, \g {s) (x)\<C, (s = 3,...,6). (1.18) 

In fact the only place where we use the real form of g(x) is that the limiting system of equations ( |1.11| ) 
has the unique solution (see [ 5-T2 Q. 
We use also notations: 

An important ingredient of our proof is the following proposition: 
Proposition 1 There exists do > such that for any 5 < do 

Prob{|(i? 1)2 ) - E(R lt2 )\ >5}< e - NS2 / 2C , 
Prob{\(R hl ) - E(R hl )\ >5}< e - m2 ' 2C , 
Prob{|(i?i, 2 ) - E(R l>2 )\ >5}< e - m ' 2 / 2C , 
Prob{|(C/i)-^(C/i)| > 5} < e ~ N52 / 2C . 



(1.20) 



Corollary 1 

E{\(R 1>2 ) - E(R 1>2 )n < 2^^. (1.21) 

2 Proof of Main Results 

Proof of Proposition [J 

For the proof of Proposition |l] we need the following remark: 

Remark 2 It was proven in IS- / that there exist constants Mq, mo such that for any M > Mo 

Prob{((J, J)) > MN} < e -Nm (M-M )_ (2.1) 
Besides, it is well known that if we define 

then there exist Co, cq such that for any C > Cq 

Prob{\\A*\\ >C}< e -^ c o(C-Co) ^ 

(see e.g. \S-Tl\j ). 

We prove Proposition |l| using a method proposed in T4 1 with small modifications which we need to 
study the case, when the variables { Jj} are unbounded. 
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Lemma 1 Consider two Gaussian independent random vectors {u} and {v}. Let /(x) satisfies the 
conditions: 

P(A) = Prob{|V/(u))| 2 >A}< e -°( A - A ^ (VA > A ) (2.4) 

and for some sq 

E{e ±Sof } < e SoB . (2.5) 

Then for s < |so 

£ {e ±.(/(u)-£/(u)) } < e 2A s2 (1 + (Aq + c -l )e 2 S ^CA„/ 2) _ (2 6) 

Proof. 

The proof is very simple. Consider 

G s>t (u, v) = exp{s(/(u) - f(VT^tu + y/iv))}, <p s (t) = E{G Sjt (u, v)}. 
Then, integrating by parts, we get 

m = ^{^-/(^u + ^v) (7 ^=-^)^ ( u,v)} 

= 2^^|- /( ^ IU+ ^ V) ^ /(U)G - (U ' V) } 



< ^=¥>.(*) + ^^|^ 1/2 {\Vf(u)\*9(\Vf(u)\ 2 - 2A )} 
A s 2 ^ , s 2 e 2sS f /■ ^ ,„,^\ 1/2 



V±-t 2y/l - t \Ja>2A 

Thus we have got 

£{ e «(/(u)-/(v))} = ^(X) < e 2A s 2 (^( ) + +(7-l) e 2»B-CA)/2) i 

Since by definition y? s (0) = 1, averaging first with respect to u and then with respect to v and using 
the Iensen inequality, we get Q2.6| ). Lemma [j] is proven. 

To apply this result to / = N(Ri t 2) we have to check the condition (|2.4|). We write 



1 

N 



df 



4 



iV 2 . . 

< 4e (Ji)(ji9\s»)j 3 )ly{s„)j k )(j k ) 

N iJAv X /X 7 (2.7) 



2 



= 81 + 811. 

To estimate the r.h.s. we use the following proposition: 

Proposition 2 Consider the matrices _4 (/) : R w ^ : W ^ R n and C : W -> BP of the 

form 

.(/) _ / t. t.trrX «(/)_ „,.,„„,„.,,,. 

(2.8) 



= (WiSj - (gi(S,)))(g>(S„) - <</(^)»). 



IH«||<ffi, || g ./)|| < MfWWg i || C ||<MWQ (2 . 9) 

2 z z 



where the matrix A* is defined by (2 A) 



We prove this proposition in the next section. 



Denoting A^a = {JiJjg'{S^)) and using fl2.9|) , we obtain 

1 = w E(^ M * < J )) < J) ' (J)) < S 5 ' 2( ^ 

Similarly, taking / = 1 in the definition (|2.9|) of £>, we have got 



Proposition 3 

Since </' is bounded function, by using this proposition (see the next section for the proof) one can 



easily check the condition (2.4) for the terms I and II. 

Thus we have proved the first line of (2.6). Now by using the standard Chebyshev inequality we 
get ( 1.2C| ). The other inequalities in ( 1.20| ) can be proven similarly. 

To prove Theorem |2| we need to make some preliminary work. 
Denote 



d = q(R-q)-\ U = d+z-(R-q)- 1 ; 



(2.10) 



Lemma 2 For any < e < 1 there exists a constant C e such that uniformly in N 



\E{{R h2 )}-q\ < 



a 



\E{(g'(S,)f}-d\< 



N 1 ' 



\E{(g"(S,)+g' 2 (S,))}-U\< 



N i- 



For the proof of this lemma see Section 3. 

Using this lemma and inequality ( 1.2l| ), we get 



E{\q n \} < 2C n T(n). 
Besides, using inequalities ( 1.16|) one can get easily: 

Em >2 )} < C n T(n), E{(T?)} < C n T{n). 

Then, since R^ 2 -q = N- l / 2 {T^ 2 + T 1 + T 2 + q),we obtain 

C n T{n) 



E{\((R h2 - qT)} < 



N n l 2 



Besides, on the basis of ( 1.17|) and Lemma [2], be have got 



C 



c 



c 



E{((R l>v - dY)} < - E{(Uf)} < -, E{((Ru - R) 2 }} < -. 



N 



Here and below we denote 



N' 



Ui = Vi- u. 



N 



From this inequality, using the bound 

\RiA\u 2 \ <N- X ((J,J))\\A. 



(2.11) 



(2.12) 



(2.13) 



(2.14) 
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and inequalities ([2J]) and ( |2.3|) , we obtain for any r > 2 

£{<|iV-4 r >}<^, E{(\U\ r )}<^, E{(\R l;l -Rn}<^. (2.15) 



Following the method of [T5], we introduce the Hamiltonian 



-H t = Y,9(S; t + hVt^N- 1 ' 2 ) + ^(1 - t)uJ x 

1 - t 7 7 ( 2 -16) 

where u is a normally distributed random variable, independent of £^ and h and S~ = iV -1 / 2 ^^, 



do not depend on 



Denote (...)t the Gibbs averaging to Ht (or n replicas of Ht), and for any ^^-independent function 
defined of R, Nxn define 

u t (f) = E(f)t, v[{f) = ±v t {f). (2.17) 
for any ^^-independent function defined of H. Nxn . Besides, to simplify notation we denote 

s- - 7 (i) 

Proposition 4 For any integer n 

\M4 n )\ < C n T(n). (2.18) 

For the proof of this proposition see the next section. 

Let us compute v'tif)- Differentiating and then integrating by parts with respect to Q and u, we 
have got 

z 1=1 z 

n n 

+ Y,vt(fsis l ,(Rr, l ,-d))-nY / MfsiSn + i(RT, n+ i-d)) ( 2 -19) 
KV 1=1 

+ 2 ^(/ a «+l«f»+2(-R^+l,n+2 ~ d ))- 

Since the Hamiltonian ( 2.16| ) has the form (|1,15| ), the inequalities ( 1.16| ) and ( p.. 17 ) for this Hamiltonian 
are also valid. Therefore the estimate ( |2.13| ), and ( 2.15| ) are fulfilled and so, using the Schwartz 
inequality and fl2.15|) , we get 

WlU) - Mf)\ < Cmax^d/^iV- 1 / 2 . (2.20) 

Using the same formula to compute the second derivative of vt(f) with respect to t, we obtain the 
expression in each term of which we have {R^v — d){Ri 1 ^ — d) or {Rip — d)Ui 1 or UiU^. Using again 
( 2.15| ) and the Holder inequality, we obtain for any < e < 1: 

W/) - Mf) ~ ^o(/)l < ra r 4 ,2 (\f\^)vf{\ Sl \^)N- 1+ \ (2.21) 

To compute the averages of the type {Rip) we use another tool. Denote V>\ = d {l) . One can see 
easily that, e.g., E{{R\^)} can be represented in the form 

(V 1 V 2 G(s[ 1) )G(s[ 2) )) (p _ 
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where G(S) = e 9<yS ^ and the symbol (...)(v,_]\ means the averaging with respect to the Hamiltonian 
( 1.15Q in which g (Si) is replaced by 0. 

Let us again consider a standard Gaussian variable u and introduce a function 



G t (S,u) 



In particular, 



y/(l -t)(R-q + e) 



2 /2(R- q +e){l-t) G ^ tS + u ^ q (l_ t ) + x ) dx . 



G (u) 



-x 2 /2{R-q+e) 



G(u^fq + x)dx. 



(2.22) 



(2.23) 



It is evident, that Go(S,u) = Go(u) (i.e. it does not depend on S) and Gi(S,u) = G(S). We remark, 
that the definition (|2.22| ) becomes more natural, if we introduce it through the Fourier transform G(X) 
of the function G(S): 



G t (S,u) 



1-t 



G(X) exp{-i\(SVi + uJq(l - t)) - ^^(R ~q + e)X 2 }. 



(2.24) 



Now for any ^^-independent function / : YL Nxn 
the operator Vt = -P(t" 1/2 Pi, t _1/2 P n ) 



R and some polynomial P(x\, . . . , x n ) consider 



E 



(fV t G t (s[ 1 \u)...G(Sr',u)) ip 



(n) 



-1) 



(G t (s[ 1 \u)...G t (Sr>,u)) {p _ 1) 
V t G t (s{ l) ,u)...G(s{ n \u 



G t (s[ 1 \ u )...G(S\' l >,u) /(t) 



(n) 



(2.25) 



where (.••)(£) means the Gibbs averaging corresponding to the n replicas of the Hamiltonian ( 1.1EQ in 
which g(Si) is substituted by logGt(Si,u). According to the result of Q, this function is also concave 
with respect to Si and so inequalities ( [2. 13 ) and ( 2.14| ) for it are also valid. 

We remark here also that due to the definition Gt ( |2.22j ) the operator Vt has a natural form: 



P t G t {Sl 1) ,u)...G{S?>,u 



(n) 



2vr) r 



G(\ 1 )...G(\ n )P(-i\ 1 ,...,-i\ n ) 



exp{-i ^iS[ l) Vi- iuJ2 A|^/g(l - t) - L —^{R - q)\ 2 }. 



1 - t 



(2.26) 



So for t = it is well defined: 



P,G((si 1) ,n)...G(sS"', u ) 



fc0 = ^ 1/2 i.-"~ 1/2 i) G »(-)- G »<-) 



Let us compute the derivative with respect to t of ip[ n \fVt)- 

A 1 n 

= \Y.^\f{Ri,i - R)t~ x vfv t ) - ^I n+1) (/(^n + i,n + i - R)t- l vl +1 v 



Xl = ...=X„=U 



dt 



1=1 

n n 

+ J24 n \f(Rl,l> - q)t- x V{D v V t ) -nJ2^ n \f(Ri,v ~ q^V^^Vt) (2-27) 

KV 1=1 

n(n + l) (n+2),,, D w-l-n -n -n \ 

H ^ ft [f{Rn+i,n+2 ~ q)t L V n+ iV n+2 V t ). 



This formula can be obtained easily if we differentiate with respect to t and then integrate by parts 
with respect to £j and u in the expressions (2.24) and ( |2.26| ). 
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Proposition 5 For any polynomial P(X\, ■ ■ ■ A n ) (degP < 6) 

\^ n) (V t )\<C, (2.28) 
where constant C depends on n and on the polynomial P(x\, ...,x n ^. 

Remark 3 If we take g(x) = — logH(^=), then Proposition^ is valid for the polynomial of any degree. 

As it was mentioned above the inequalities ( [L,16| ) and ( |1.17| ) for (••■)(£) are a l so valid. Therefore the 
estimate (2.13), and (2.15) are fulfilled and so, using the Schwartz inequality, Proposition ^ and ( 2.15| ), 
we obtain: 

\<P { ?\fPx) - ^\fV )\ < Cmax^ 1/4 (|/| 4 )iV-i/2. (2 29) 

Using the same formula to compute the second derivative of (Pt (fPt) with respect to t, we obtain the 
expression in each term of which we have (Rij* — q)(Ri 1 ^i' 1 — q) or (Rij* — q)(Ri lt i 1 — R) or (R^^ — R) 2 - 
Using the Holder inequality, Proposition [5] and ( |2.15|) , we obtain: 

I^S n) (/^i) - ^\m) - j/o\m)\ < C maxv}^ f\*)N-\ (2.30) 

Proof of Theorem [1 

We prove Theorem^ in 3 steps which are Lemma ||, |] and |j| 

Lemma 3 Consider an expression of the form T^ 2 P where P is some product of the terms Tij 
(different from T\^), Ti and q. Then 

E{T^P) = (k — l)AE(T^ 2 P) + 0{N- 1/2+e ), (2.31) 

where 

A= . h \ , (2.32) 
1 — aboCQ 

with 

b = (R-q) 2 , c = q- 2 E{(gZ(u)) 2 }, g (u) = log G (u), (2.33) 

where E{..} means the averaging with respect to the standard Gaussian random variable u and Gq[u) 
was defined in ( 2.2S ). 

Lemma 4 Consider an expression of the form T^P where P is some product of the terms Ti with 
i ^ 1 and q. Then 

E(T?P) = (k — 1)BE(T?- 2 P) + 0(N- 1/2+e ) (2.34) 
where B is some N -independent constant which is an algebraic expression of the coefficients bo, cq and 

b 1 =E{{s 2 ) (s) 2 } = q(R-q) 

d = £{<(£>! - D 2 )PiW) ( o)} = q- 2 E{gMf} 

c 2 = E{((V X - V 2 )V 2 V 3 ) {0) } = q- 2 E{(g>>> + 2g»g )g Q } (2.35) 

>(0)1 
'(0): 



c 3 = E{((V 2 - V 2 )V 2 ) m } = q- 2 E{(g ( 4) + 4g "g' + 2(^') 2 + Ag'M) 2 )} 
c 4 = £{<PiP 2 P 3 ^4}(0)} = q- 2 E{{g'^}. 



Forh = 



d 2 F 1 

B = 2— + -A (2.36) 
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Lemma 5 

E(q k ) = (k - l)CE(q k - 2 ), (2.37) 
where C is some N -independent constant which is an algebraic expression of the coefficients &o,i , 

C0,1, 2,3,4- 

One can see easily that the statement of Theorem [2] follows from these lemmas by induction. So our 
goal is to prove the Lemmas. 

Proof of Lemma [|. First of all we rewrite all terms of our initial product (including all T± 2) in the 
form 

T M , = AT-V2 ( j-(0 _ j-(*))(j-(0 _ jr-(*0) + AT-i/2(j(0 _ jf ) _ jf ')) 

T; = AT-V2(j-(0 _ + iV-i/2(j(0 _ jf 1)) j«) (2.38) 

q = N- 1 /\{J-^\J-^) -(N- l)q) + N' 1 ' 2 (J^J^ - q), 

where indexes k, k' , k\, k[, k 2 , k' 2 are different for each term in the product and different from initial 
indexes We denote the last term in i-th expression by N~ 1 / 2 fi(Ji). Using the symmetry of the 
Hamiltonian and the above representation, we can write 

E{T k 2 P} = VN^(( Sl - s k )(s 2 - s k ^)P-) 

+ - s k)(s2 - s k/ )fi(s)Pr) + 0{N- 1 ' 2 ) (2.39) 

i 

= I + II + OiN- 1 / 2 ), 

where P~ means the product only of such terms of (|2.38j ) which does not contain s; (including that, 
corresponding to T\ 2 ) and P^~ means the product of the same terms except the i-ih. one. The term 
0(N~ 1 ^ 2 ) appears because of the products which contain more than 1 term fi(s). Applying formula 
(|2.20D to the term II, we have got 

// = Y, u o((si-s k )(s 2 -s kl )f i (s))iy 1 (Pr) + 0(N- 1 / 2 ) 

i 

= ^((si - Sk)(s 2 ~ s kl )fi{s))vi(Pi) + OiN- 1 ' 2 ). 

i 

But, if fi(s) does not contain both s\ and s 2 , 

M( s i - s k ){s 2 - s k >)fi(s)) = 0. 

So we obtain 

II={k- l)b E{(T^ 2 P)} + OiN- 1 ' 2 ). (2.40) 

Now let us analyze term /, using formula fl2.21|) . It is evident that uq term here is equal to 0. 
Calculating u' , we get 

n 

I = ^/Nj2M(si - s k )(s 2 - s kl )s lSl/ )n(Rj- tll - d)p-) + OiN- 1 / 2 ^). 

KV 

All the rest terms in ( |2.19| ) disappear because 

^0((S1 - S k )(s 2 - S k t)siSi>) = & (^,1^',2 + <^,fc<fy,fc' - $l,k&V,2 - <5/,fc'^',l)- 
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So, we have got 

/ = b VNE{{(R lj2 -R ljk , -R^ k+ R Kkl )p)} + 0{N- l / 2 +t) 
= boll I + 0{N- 1 l 2+e ). 

To analyze III we use again the symmetry of ( 1.15| ) and notations of ( 2.25| ) to write 

a" 1 /// = V / iV^{((5 / (^ 1) )-5'(^ ) ))(5 , (^ 2) )-5'(^ fc ' ) ))P)} 
= JV^VCPl - V k ){V 2 - V k ,)P). 

Now, applying formula ( |2.30| ), we can write 

a' 1 III = ^Y,<t>o{{'Dl-'Dk){T> 2 -V k/ )ViD ll )E{{{R l>v - q)P)} + 0(N- l / 2+t ) 
KV 



(2.41) 



(2.42) 



All the rest terms in ( |2.27 ) disappear because 

(po((p x - V k )(V 2 - V k ,)) = 0, ^((Dx - V k )(V 2 - V k ,)V 2 ) = 0. 

Let us remark that 

<Po{(T>i - V k )(V 2 - V k i)V{D v ) = co(5{,i5{/ )2 + Si,kh',k> - $i,k8i',2 - Si t k'Sii t x), 

with Co defined in (|2.33| ). 

Hence we get from ( |2.42 ) that 

a- 1 /// = c VNE{{{R^ 2 -R 1M -R 2>k + R kM )P)} + O{N- l l 2+ ') 
= c E{(Tl 2 P)} + O{N-y 2 +^). 

Now, using relations (gig ), ( |239| ), plpp , pTjl]) , pl2|) and ( gg| ), we get fl2~3ll ). Lemma | is proven. 
Proof of Lemma [| 

Like in the proof of Lemma |2| we use representation ( 2.38 ) for all the terms and let for the first T\ the 
numbers of replicas here are 1,2,3 and for the i-th 2\ they are (l,Zj,Zj + 1). Using the symmetry of 
the problem similarly to ( 2.3S| ) write 



(2.44) 



(2.43) 



E{T*P} = ^fNv x {( Sl -s 2 )s3P-) 

k 
i=2 

= I + 11 + 0{N-^ 2 ), 

where P~ means the product only of such terms of ( |2.38| ) which does not contain si and P[~ means 
the product of the same terms except the i-th one. By the same way as in Lemma we get 



II={k- l)hE{T^- 2 P} + 0{N- l l 2 ) 
where friis defined by ( |2.35 ). Using the formula ( |2.21| ) we have got 



(2.45) 



oT l I 



2b 1 E{{(U l - U 2 )P)} + b E{((R h3 - R 2 , 3 )P) 



+6i E i((Ri,i ~ R2,i)P)} ~ nhE{((R 1>n+1 - R 2 , n+ i)P)} 

1=3 



+ 0{N- 1/2+t ). 



(2.46) 
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Using again the symmetry and notations fl2.25| ), we write 



2& m ((D? - V 2 )P) + boipxUPi - V 2 )V 3 P) 



+h J2 MPi ~ ^2)ViP) - nhMVi - V 2 )V n+1 P) 

1=3 



+ 0(N 



-l/2+e 



)• 



Applying formula ( 2.27] ) we get 



N 
(i) 



4 1} E{((R 1A - R 2 , 2 )P)} + 4 1 ^{((i?l, 3 " R2,3)P}} 



(1) 



J2 E {(( R l,l - R 2,l - Rl,n+1 + R2,n+l))P)} + O^ 1 / 2 ^) 
1=3 1 

= a^E{((R 1A - R 2 , 2 )P)}VN + a^ElTfP} 
+(k - l)Aa ( ^E{T^- 2 P} + 0{N- l / 2 +"), 

where a[\ 3 are some algebraic combinations of &o,i an d 00,1,2,3,4 defined by ( 2.35 ). 
Here we have used Lemma 0, according to which 



(2.47) 



NE{{(R U - R n - R 1>n+1 + R 2 ,n+i)P)} = E{{T 2 yl T k - 2 P)} = AE{T?~ 2 P} + 0{N 



-1/2+e 



for I = li (i = 2 . . . , k) and it is zero for the rest of I. Now we are faced with a problem to compute 
E{((R hl -R 2 , 2 )P)}VN. 

By using the same procedure we can get 



NE{{(R hl - R 2t2 )Tt l P)} 



2h(k - 1)E{T?- 2 P} 

+aaf ] E{({R lyl - R 2y2 )Tt l P)}^N 

+aa£ ] E{T*P} + (k - l)aaf ] E{T*~ 2 P} + 0(N~ l / 2+e ) 



where a\ 2 3 are some algebraic combinations of 60,1 and 00,1,2,3,4 defined by (2.35). 
Now we have got the system of two equations with respect to E{T^P} and 
E{((R lfl - R^T^P^VN. This system gives us 



(2.48) 



E{T?P} = (k - l)BE{T^ 2 P}, E{((R 1A - R^T^ 1 P)}Vn = (k - 1)BE{T^ 2 P}VN (2.49) 
with some B and B. But using the fact that B and B do not depend on k, we observe that 



dzdh 



d 2 F 



Then since 



d 2 F 

dzdh 



for h = 0, we get 



B 



d 2 F 

dz 2 



(2.50) 



Similarly one can get 

d 2 F 



d 2 F 

dzdh 



4B + 4E{{T?)}-2E{{T? 2 )} 



R - q - 4B + 4B - 2A. 
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Thus, using the fact that 

Proof of Lemma |^ 
We write 



R — q for h = 0, we have got formula ( |2.36| ) for B. 



d 2 F 
dh 2 



E{q k } = VNv 1 {{s l s 2 -q)P-) 

k 

+ Y,M(sis 2 -q) 2 p-)+0(N- 1 / 2 ) 

i=2 

= I + II + 0(N~ 1 / 2 ), 



(2.51) 



where 



One can see easily 



P~ = I[N 1/2 (R2l-l,2l-q) 

1=2 

II={k- l)q 2 E{q k - 2 } + 0{N~^ 2 ) 



(2.52) 



Calculating / with (|2.20[) we get 



I 2 J2l<l> v l({Rl,V — Rl,n+1 — Rl',n+2 + Rn+l,n+2)P 



(2h -q 2 )Y, M(Rl,2 ~Rl,2)P~ 
l>3 



J2»i((Ri,i-Ru) p ~ 



(2.53) 



l>3 



+(bo ~ 2b 1 )v 1 ((R h2 - d)P~) + 2Mi(0Ri,i - U)P~) 



+ 0(N- 1 / 2+e ). 



Here we have used that since P does not contain replicas 1 and 2 we can replace n + 1, n + 2 — > 1,2 
Now we apply formula ( |2.3[1| ) using the following relations: 

E{{T hV P)} = AY,k2k-i5i',2kE{q k - 2 } (/</'), 

k=2 

EmP)} = BE{q k - 2 }, 
~NE{((R lt i — Rij)P)} = -BE{q k - 2 }. 



These relations follows from Lemmas [| || and formula (|2.5C| ) . 

a- 1 / = E{((R 1A - R)q k - 2 )}VN 

-afE{q k ] + (k- l)afE{q k - 2 } + 0(i\rV2-K) 



(2.54) 



So we have got the equation 
E{q k } 



(k-l){q 2 + aaf)E{q k - 2 } 

(3) vntv r>\-k-2\^.f7J , „.„(3) 



+aafE{((R 1)1 - R)q k - 2 )}VN + aaf ' E{q k } + 0{N- l l 2+ '), 



(2.55) 



where a\_ 2 3 are some algebraic combinations of &o,i and 00,1,2,3,4 defined by ( |2.35| ) 
By the same way, studying yf~NE{{{R\j_ — R))q k ~ 1 }, we get the equation 



{k-l){q 2 + aaf)E{q k - 2 } 



NE{((Rl l — R))<j } — yrv — ±jyq t uu.3 

+aa^E{((R 1A - R))q k - 2 }^fN 
+aa { 2 4) E{q k ] + OiN- 1 / 2 ^), 



(2.56) 
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where 3 are some algebraic combinations of 60,1 and 00,1,2,3,4 defined by ( 2,35|) 



Considering (|2.55| ) and ( |2.56|) as a system of equations with respect to E{q k } and 
^/V-E{((i?i,i — R))^^ 1 }, we finish the proof of Lemma [El. 



3 Auxiliary results 

Proof of Proposition [Ij Consider any x, y G H N and write 

(.AWx.y) = (( J,x)( j,y)/> < ((J,x) 2 (J,y) 2 )^ (/2) i/ 2 < ^^!| x | | y |, 



where we have used inequality (1.16). Similarly, using inequalities ( |1.16| ) and ( 1.17] ), for any x 6 
R p ,y G 

(0(/)x,y) = ((j,x) 4 ) 1 /4 (/ 4 ) l/4^ (/( ^ ) _ ( y (5/i))) 2 y ^ 1/2 

The inequality for the matrix C can be proven by the same way. 
Proof of Proposition [| 



From ( 1.1 8| ) one can easily derive that 

(g'(S)) 2 <d-C 25 (5). 

Thus it is enough to prove that 

(-^5>(^))<a 

Define the Hamiltonian 

-n(T) = r^2g(s^) + z(j,j). 

Let (...) T be a corresponding Gibbs average. One can see easily that 



is a decreasing function of r. Thus 



< £<E<^<-^E(^^) 







Proof of Lemma ^ 
We prove first that 



h(#i j2 ) - MRi,2)\ < ^, Wt(Ui) - MUi)\ < fa 
\<Pt{Ri,2) - MRi,2)\ < fa, Wt{Ri,i) - sPo(fli,i)| < 



(3.1) 



To this end consider the Hamiltonian H^{t) which has the form ( 2.16 ) with d, U substituted by 



d N = v (g'(sU)g'(sM)), u N = Mg"(S,) + g' 2 (S^)) 
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respectively. Then we use formula (&A$) for / = ^#1,2 and / = VNU U but we write it in the form: 



n 



4(f) 



5 E - </)t)«?(^ - ^)) + E - </>*)^h^> - d N )) 



1=1 

-n 



KV 



+ 



E ^((/ - (/)t)^ s n+l(-R/ jn+ i - djv)) 
n(n + 1) /£- 

V JL n+l,n+2 



(3.2) 



Using the Schwartz inequality and ( p. .IT ), due to the terms vt{{f — (f)t) 2 ) we obtain the first line of 
(3.1). But then, on the basis of (|3.lD one can derive from ( |3.2|) that the first line of ( |3.lD is valid even 
if we replace CN- 1 / 2 by CN~ l . Now similarly to Q2.15Q one can conclude that for any r > 2 



E{{\R hl , - d N \ r } < ^ E{(\U t -U N \ r )}<^- 



(3.3) 



Similarly, using ( 2.2Tj ) for / = y/NRi^ and / = y/NRx,i with qjy = 0o( s i s 2)> -R;v = </>o(si), we prove 
first the second line of ([O]). Then, by the same way as above, we get 



E{{\R l>v - q N \*)} < ^, E{(\R ltl - R N \ 2 )} < 



(3.4) 



Now we remark that since it was proved in | S-T2| , that the system ( |1 . 1 1 ) has a unique solution, to 
prove (2.11) it is enough to show that our q^, Rn satisfy this system with the error terms 0(N~ 1+e ) 
and djVj Un satisfy relations ( |2.10| ) with the same error. Now, on the basis of ( |3.3[ ) and ( |3.4[ ) it can 
be shown easily by formulas ( 2.1S| ), ( [2.21 ) with /(s) = S1S2 and f(s) = s\ and by formulas ( |2.27j ) and 
(|2T30| ) with / = ViD 2 and / = V\ . 

Proof of Proposition Q 
Let us denote 



2 

<f>(s) = log J dJ- exp{-H t (J-,s)} = Ms) + uayjd{l - t) - S -{z -{l-t)(U- d)) 
According to the results [|J, <j>t(s) is a concave function. Besides, there exists 5 > such that 



(3.5) 



(z - (1 - t)(l7 - d)) >(z-(U- d)) = (R 
Then, according to the results Q, 

(\s-(s) ( f > \ n } (f> <6- n 2 n r(n). 



> 5. 



(3.6) 



So, to prove Proposition ||] it is enough to estimate (s)$. 

Denote s* the point of maximum of the function <p(s). Then it follows from representation ( [3.5| ) 
of the function </>(s) that 

|s*| < <TVt(°) + u^/d(l-t)|. 

On the other hand, by 0] 
Now, since 



\(s)*\ <r : (i + |^(o) + A /d(i-*H) 



6 t(°) = E^(5 , (^-))c 
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and (...)o does not depend on £± , we have 



E{(s) n } < 2 n 5- n T(n) (cf + e{ (V 1 ^(3^))^^ . 

Then using Proposition ||, we obtain the statement of Proposition |I[ 
Proof of Proposition 

According to the representation (|2.26j ), Vt is some polynomial of the derivatives -M^ log Gt(S^\ u) 



(k = 1,..,6, j = l,...,n). But under condition ( 1.18Q for k > 2 these derivatives are uniformly 
bounded functions. So we need only to prove that 



E {((^logG t (S»,»)) 2 ') (() }<C W . (3.7) 



Similarly to the proof of Proposition |] by ( JL. 17 ) and ( |1.18| ) inequality ( |3.7| ) can be derived from the 
inequality 

4( (^ iogG ^ s '? ) '^)X)} ~ C(A;) ' (3,8) 

But similarly to the proof of Proposition ||, since 

^ log , u) V < Ci - C 2 log G, (S^ , «), 



^logGtOS^u))") < C7i - G^logG^,^ o 



one can get that 

Now, since (. . .)( ) does not depend on {^j }u=ii (|3-S|) follows immediately. 
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